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Abstract 

In the paper we develop an approach to asymptotic normaHty through factorial cumulants. Facto- 
rial cumulants arise in the same manner from factorial moments, as (ordinary) cumulants from (ordinary) 
moments. Another tool we exploit is a new identity for "moments" of partitions of numbers. The general 
limiting result is then used to (re)derive asymptotic normality for several models including classical dis- 
crete distributions, occupancy problems in some generalized allocation schemes and two models related 
to negative multinomial distribution. 



1 Introduction 

Convergence to normal law is one of the most important phenomena of probability. As a consequence, a 
number of general methods, often based on transforms of the underlying sequence have been developed as 
techniques for establishing such convergence. One of these methods, called the method of moments, rests 
on the fact that the standard normal random variable is uniquely determined by its moments and that for such 
random variable X if is a sequence of random variables having all moments and EX^ — EX^ for 
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all A; = 1, 2, . . ., then X„ A- X - see, e.g. [22, Theorem 2.22] or [2, Theorem 30.2]. Here and throughout 
the paper we use to denote the convergence in distribution. 

Since moments are not always convenient to work with, one can often use some other characteristics 
of random variables to establish the convergence to normal law. For example in one classical situation we 
consider a sequence of cumulants (we recall the definition in the next section) rather than moments. On the 

one hand, since the kth cumulant is a continuous function of the first k moments, to prove that X„ A- X 
instead of convergence of moments one can use convergence of cumulants. On the other hand, all cumulants 
of the standard normal distribution are zero except of the cumulant of order 2 which equals 1 . This often 
makes establishing the convergence of cumulants of to the cumulants of the standard normal random 
variable much easier. We refer the reader to e.g. [8, Section 6.1] for more detailed discussion. 

In this paper we develop an approach to asymptotic normahty that is based on factorial cumulants. They 
will be discussed in the forthcoming section, here we just indicate that factorial cumulants arise in the same 
manner from factorial moments, as (ordinary) cumulants from (ordinary) moments. The motivation for 
our work is the fact that quite often one encounters situations in which properties of random variables are 
naturally expressed through factorial (rather than ordinary) moments. As we will see below, this is the case, 
for instance, when random variables under consideration are sums of indicator variables. 

In developing our approach we first provide a simple and yet quite general sufficient condition for the 
central limit theorem in terms of factorial cumulants (see Proposition 1 in the next section). Further, as we 
will see in Theorem 3 below, we show that the validity of this condition can be verified by controlling the 
asymptotic behavior of factorial moments. This limiting result will be then used in Section 5 to (re)derive 
asymptotic normahty for several models including classical discrete distributions, occupancy problems in 
some generalized allocation schemes (gas), and two models related to a negative multinomial distribution; 
they are examples of what may be called generalized inverse allocation schemes (gias). Gas was introduced 
in [13] and we refer the reader to chapters in books [14, 15] by the same author for more details, properties, 
and further references. The term "generahzed inverse allocation schems" does not seem to be commonly 
used in the literature; in our terminology the word "inverse" refers to inverse sampling, a samphng method 
proposed in [6]. A number of distributions with "inverse" in their names reflecting the inverse sampling are 
discussed in the first ([10]) and the fourth ([9]) volume on probability distributions 

We believe that our approach may turn out to be useful in other situations when the factorial moments 
are natural and convenient quantities to work with. We wish to mention, however, that although several 
of our summation schemes are, in fact, gas or gias we do not have a general statement that would give a 
reasonably general sufficient conditions under which a gas or a gias exhibits the asymptotic normahty. It is 
perhaps, and interesting question, worth further investigation. 

Aside from utihzing factorial cumulants, another technical tool we exploit is an identity for "moments" 
of partitions of natural numbers (see Proposition 2 in Section 3). As far as we know this identity is new 
and may be of independent interest to combinatorics community. As of now, however, we do not have any 
combinatorial interpretation, neither for its vahdity nor for its proof. 
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2 Factorial cumulants 



Let X be a random variable with the Laplace transform 

k=Q 

and the cumulant transform 



k=0 

Then ji^ = 'iS.X'^ and Kk are, respectively, the kth moment and the feth cumulant of X, k = 0,1, The 

Laplace transform can be also expanded as 

^x{t) = J2^k ^, ^ , (2.1) 

k=0 

where is the A;th factorial moment of X, that is uq = I and i^fc = E (X)^ = E X(X — 1) ... (X — A; + 1), 
A; = 1, . . .. Here and below we use the Pochhammer symbol {x)k for the falhng factorial x{x — I) . . .{x — 

(fc-1)). 

The sequences (/x^) and (k^) satisfy /x^ = for A; = 0, 1 and 

k-l _ ^\ 

i^k = IJ-k-^ [ . _ , ] i^jt^k-j , for A; > 2 . (2.2) 
The sequences (/Xfe) and (f^) satisfy /xq = f o = 1 and 

k 

l^k = ^ S2{k,j)uj , for/c>l, 

where 5*2 (A, j) are the Stirling numbers of the second kind defined by the identity x'' = Yl^=i S2{k, j){x)j 
holding for any x G M (see e.g. [5, (6.10) in Section 6.1]). The vahdity of (2.2) follows from the relation 

ct>{t) = exp(V'(i)). 

Following this probabilistic terminology for any sequence of real numbers (a^) one can define its cumulant 
sequence {bk) by 

= exp|^6fc-|. (2.3) 

This relation is known in combinatorics under the name exponential formula and its combinatorial interpre- 
tation when both (on) and (6^) are non-negative integers may be found, for example, in [20, Section 5.1]. 
Properties of sequences related by (2.2) are usually proved in the combinatorial or probabihstic context, 
but since the proofs typically involve operating on either side of (2.2) and equating coefficients, they hold 
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universally. Thus, for example, if (a„) and (6^) satisfy (2.3) then (see e.g. [20, Proposition 5.1.7] for a 
proof) 




A; > 1 , 



where we adopt the usual convention that a sum over an empty range is zero. Note that the sequence b = {b^) 
is obtained as a transformation f = {fk) of the sequence o = (ofc), that is 6 = /(a), where /^'s are defined 
recursively by = xi and 

fk{x) = Xk-^ i . fjix)xk-j , k> 1 . (2.4) 
j=i V / 



For a future use we record here that if b = (6„) is a cumulant sequence for a sequence of numbers 
a = (an), that is, b = f{a) then for any J > 1 



J 



6j = E^-n«r% where Z?, = -LilZL—A ('^ £ "'^ ] , (2.5) 

i=l i=l 



mi, ...,mj 



and where the sum is over all partitions tt of a positive integer J, i.e. over all vectors tt = (mi, . . . , mj) 
with nonnegative integer components which satisfy X^jLi ^"^i = J (for ^ proof, see e.g. [12, Section 3.14]). 

Returning for a moment to the probabilistic notions introduced at the beginning of this section we con- 
clude that K = f{fx) with / defined by (2.4). 

Similarly for any sequence of real numbers (a^) one can define recursively the factorial sequence (c^) 

by 

k 

Ofe = X] -^sl^, j)cj , for A; > 1 . 

Consequently, 

k 

hk = Y.^'^^^^j)fi^^) ^ A; = 1,2,... (2.6) 

This observation is useful for proving convergence in law to the standard normal variable. 
Proposition 1. Let (Sn) be a sequence of random variables having all moments. Assume that 

YavSn "-=^ oo (2.7) 

and 

^|^"^0. (2.8) 
Var2S'„ 
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For any n = 1,2, . . ., let c^^ = (c^ „)fc=i ... be a sequence of factorial moments of Sn, that is c^^n = E {Sn)k' 
k = 1, 2, . . ., and let fj_n = fj{c^ (where fj is defined by (2.4)) be the Jth factorial cumulant of Sn, 
J = 1,2, Assume that 

fj,n n-^ Q foranyJ>3. (2.9) 
Var2S'n 

Then 

t^n = ^^=^^Ar(0,l). (2.10) 

Proof. We will use the cumulant convergence theorem (see e.g. [8, Theorem 6.14]). Let Kj^n denote the 
Jth cumulant of Un and recall that all cumulants of the standard normal distribution are zero except of the 
cumulant of order 2 which is 1. It is obvious that ki^„ = and K2,n = 1- Therefore to prove (2.10) it 
suffices to show that /t j „ ^ for any J > 3. By (2.6) 

_ E/=l S2(,J,j)fj,n 

Var2S'„ 

Fix arbitrary J > 3. To prove that Kj^n — > it suffices to show that 



fj,n 



J 



Note first that by (2.4) 



forall j = 1,2,... , J . (2.11) 



fi,n = ESn and /2,„ = Var(S„)-ES„ 
Therefore the assumptions (2.7) and (2.8) imply (2.11) for j = 1, 2. 

If j G {3, . . . , J — 1} we write 

fj,n _ fj,n ^ 

YaASn Var2 5„ Var^5„ ' 
By (2.9) with J = j the first factor tends to zero and by (2.7) the second factor tends to zero. 

Finally, for j = J the conditions (2.1 1) and (2.9) are identical. □ 



The above result is particularly useful when the factorial moments of Sn are available in a nice form. 
We will now describe a general situation when this happens. 

For any numbers Sj, j = 1, . . . , N, assuming values or 1 we have 

^^^'^= E F-^'n(x-ir = i + E(--ir E ^n-s^^- 

m=0 ^ ^ m=l l<ji<...<jm<N 



5 



Therefore if (ei , . . . , ejv) is a random vector valued in {0, 1}^ and S = Yli=i 

oo 

m=l l<ji<---<jm<N 

Comparing this formula with (2.1) we conclude that factorial moments of S have the form 

E(S)fc = fc! P(eji = ej2 = --- = ej, = l)=:cfe, fc = l,2,.... (2.12) 

l<ii<...<ifc<Af 

If, in addition, the random variables (ei, . . . , cat) are exchangeable then the above formula simpUfies to 

E(5)jfc = (7V)fe P(ei = . . . = efc = 1) =: Cfe , fc = l,2,.... (2.13) 

As we will see in Section 5 our sufficient condition for asymptotic normality will work well for several 
setups falling in such a scheme. This will be preceded by a derivation of new identities for integer partitions 
which will give a major enhancement of the tools we will use to prove Umit theorems. 

3 Partitions identities 

Recall that a partition vr of a positive integer J is any vector tt = (mi, . . . , mj) with nonnegative integer 
components which satisfy Ylii=i ^"^i = J- we discussed earUer (see (2.5)) if 6 = = /(a) is a 
cumulant sequence of a = (a„) with / defined by (2.4) then 

ttCJ 1=1 

with {D^) as in (2.5). Note that for J > 2 

= . (3.14) 

ttC J 

This follows from the fact that all the cumulants of the constant random variable X = 1 a.s. are zero except 
of the first one. 

For TT = (mi, . . . , mj) we denote Ht^{s) = Ylii=i s = 0, 1, 2 The main result of this section 

is the identity which extends considerably (3.14). 

Proposition 2. Assume J > 2. Let I > 1 and Si > 1, i = 1, . . . , I be such that 

I 

^s, <J + 7- 2. 

1=1 

Then 

I 

Y D^Y[H^{si)=Q- (3.15) 

ttCJ j=l 
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Proof. We use induction with respect to J. Note that if J = 2 than / may be arbitrary but Sj = 1 for all 
z = 1, . . . , /. Thus the identity (3.15) follows from (3.14) since Ht^{1) = J for any J and any it C J. 

Now assume that the result holds true for J = 2, . . . , — 1, and consider the case of J = K. That is, 
we want to study 

1 

ttcK i=l 

under the condition Yli=i si < K + I — 2. 

Let us introduce functions gi,i = 1, . . . ,K,hy letting 

{(mi, . . . ,mi_i + l,mj - 1, . . . ,m.K-i) if i / 1,-fC, 
(mi - 1,777,2, ... ,mx_i) if i = 1, 

{mi,. . . ,mK-2,mK-\ + l) if i = K . 

Note that gi : {tt C K : mj > 1} — > {tt C (K — 1) : rhi-i > I}, i = 1, . . . , K, are bijections. Here for 
consistency we assume mo = 1. 

Observe that for any s, any ir C K such that mi > 1, and for vr = §1(71) C {K — 1) we have 

H^{s) = H^{s) + ly = H^{s) - 1 - As{i - 1) , 

where Ag{i — 1) = X^^Zi (^) (i — l)'^ is a polynomial of the degree s — 1 in the variable i — 1 with constant 
term equal to zero. In particular, for z = 1 we have -/?#(«) = Ht^[s) — 1. Therefore, expanding Ht^{s\) we 
obtain 

IK I 

^ n H^{si) =Y.'''Y. n + 1 + ^-.(^ - • 

ttCK 1=1 i=l ttCA" i=2 

mi>l 



Note that if m,- > 1 then 



—imiD-^ = < 



(_l)M^-lJ^^^l 



1 ^K-l 



M^(mi-l)!'n'mfc!(fe!rfc 

fc=2 



(ii-_l)! 



{-l)M^-->-MJ. 



fe=2 



= (j^ii)! -P^"^»-i if z = 2, . . . , 



where tt = (m-i, . . . , ttik-i) = 9i{T^), respectively. Therefore, 



K-l 



(3.16) 



TVCK 1=1 



j=l nC{K-l) 
I 



j=2 



+ E E D^m-ii''-^ n [^^(^j) + 1 + ^^(^ - 1)] 



i=2 ji-c{K-l) 
rhi-i>l 



i=2 
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The second term in the above expression can be written as 

K-l I 

D^mii + '^y'll [H^{sj) + 1 + As,{i)] . (3.17) 

2=1 TtC(K-l) j=2 

Note that 

(i+i^-^n Wsj) + 1 + AM 

si-1 / _ -|\ ^-1 M 

r=0 ^ M=0 2<ui<...<UM<I h=l 2<j<I 

j^{ui,...,UM} 

The term with r = and M = / — 1 in the above expression is nj=2 W-a-i^j) + 1]' tt'iis ^^'i^ of ^^e 
sum (3.17) cancels with the first term of (3.16). 

Hence, we need only to show that for any r G {1, . . . , si — 1}, any M G {0, ...,/ — 1}, and any 
2 < ui < . . . < um < I 

M K-l 

z{K-r 

Observe that the expression 



7i-C(-fs:-l) h=l 1=1 2<i</ 

j^{ui,...,UM} 



K-l 

j=l 2<j<7 

j(^{ui,...,UM} 

is a hnear combination of ifj^- functions with the largest value of an argument equal to 

2<i</ 

Therefore the left-hand side of (3.18) is a respective hnear combination of terms of the form 

w 

Y ^^U ^*(*«') (3.19) 

7fC(A'-l) ^ = 1 

where 

W M I 

< ^Su,-(M-W^+1)+ J2 {sj-l) + Si-l<J2s^-iM-W+l)-iI-l-M)-l. 

w=l j=l 'iKjKI i=l 

j<^{ui,...,UM} 

But we assumed that J2i=i Si < K + 1 — 2. Therefore 

w 

Ytw<K + I-2-{M-W + l)-{I-l-M)-l = {K-l) + W~2. 



w=l 
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Now, by the inductive assumption it follows that any term of the form (3.19) is zero, thus proving (3.18). □ 



Note that in a similar way one can prove that (3.15) is no longer true when 

i=l 

Remark Richard Stanley [21] provided the following combinatorial description of the left hand side of 
(3.15): put 

Fn{x) = J2S2{n,k)x\ 
k 

and let (s^) be a sequence of positive integers. Then the left hand side of (3.15) is a coefficient of x'^ / J\ in 

V Bev 

where the sum ranges over all partitions of a set {1, /} into \V\ nonempty pairwise disjoint subsets, 
and where for any such subset B eV 

aB = ^Si- 

ieB 

In the simplest case when / = 1 for any postive integer si, the left-hand side of equation (3.15) is equal to 

J\S2{si, J). Since this is the number of surjective maps from an si-element set to a J-element set, it must 
be for ,si < J which is exactly what Proposition 2 asserts. It is not clear to us how easy it would be to 
show that (3.15) holds for the larger values of /. 



4 CLT - general setup 

To illustrate and motivate how our approach is intended to work, consider a sequence (Sn) of Poisson 
random variables, where 5„ ~ Voisson{\n). As is well-known if A„ -> oo then [/„ = "^/"^g" converges 
in distribution to AA(0, 1). To see how it follows from our approach, note that E5„ = VarS^ = A„ and 
therefore the assumptions (2.7) and (2.8) of Proposition 1 are trivially satisfied. Moreover the factorial 
moments of Sn are Cj,n = A^. Consequently, Y\.i=i ~ ^ii f^'" P^ition tt = (mi, . . . , mj) of J G N 
and thus 

J 

/J,n = /j(cj = I).n<n = A;:E 

ttCJ «=! ttCJ 

It now follows from the simplest case (3.14) of our partition identity that = as long as J > 2. Hence 
the assumption (2.9) of Proposition 1 is also trivially satisfied and we conclude the asymptotic normality of 

The key in the above argument was, of course, a very simple form of the factorial moments Ci,„ of Sn 
which resulted in factorization of the products of c^^ in the expression for It is not unreasonable. 
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however, to expect that if the expression for moments does not depart too much from the form it took for 
Poisson variable, then with the full strength of Proposition 2 one might be able to prove the clt. This is the 
essence of condition (4.20) in the next result. This condition when combined with the extension of (3.14) 
given in Proposition 2, allows to refine considerably Proposition 1 towards a possible use in schemes of 
summation of indicators, as was suggested in the final part of Section 2. 

Theorem 3. Let (Sn) be a sequence of random variables with factorial moments Ci^n> = 1,2,.... 
Assume that (2.7) and (2.8) are satisfied and suppose that Ci^n can be decomposed as 

Q*-"^ (i) 

Q,„ = 4exp I I , i,n = l,2,..., (4.20) 

where {L^) is a sequence of real numbers and Qj^^ is a polynomial of degree at most j such that 

\Qf-^ < {ay V?gN (4.21) 
with C > a constant not depending on n or j. Assume further that for all J > 3 



L'l 



n-^~^Yaj: i Sn 



0. (4.22) 



Then 



[/„ = -^==^ AAr(0,l) as n^oo. (4.23) 



Proof. Due to Proposition 1 we need only to show that (2.9) holds. The representation (4.20) implies 

fj,n = E ^-ri € = E 

ttCJ i=l -kCJ 



where 



^-(•^'") = E^^ ^ith 4")(j) = E^^Qffi(0- 

7>1 



j>l - i=l 

Fix arbitrary J > 3. To prove (2.9), in view of (4.22) it suffices to show that D^^e^'^^'^'^^ is of order 

To do that, we expand e^^^"^'^^ into power series to obtain 



ttCJ ttCJ 



TTCJ S=0 \j>l ■' J 



E^E;^ E n^E«^fl4"'&). 

S>\ ' 1>S jl,-,js>l ^^^==1 ■^'^ TTCJ fe=l 
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We claim that whenever Ylk=i jk ^ J — "^ then 



ttCJ k=l 



(4.24) 



To see this, note that by changing the order of summation in the expression for yli"^ (j) we can write it as 

(n) 



k=0 



where are the coefficients of the polynomial Qj"'\ that is Q^^\x) = Ylk=o Consequently, 

(4.24) follows from identity (3.15). 

To handle the terms for which J2k=i Jk > J — "^ note that 

J 



where K > is a constant depending only on J (and not on the partition tt). Hence, 



ttcJ k=l 



ttcJ k=l 



(4.25) 



where (7 = J^ncJ i^^l ^ constant depending only on J. Therefore, restricting the sum according to 
(4.24) and using (4.25) we get 



ttCJ 



Ztt iJ,n) 



- Yj gl X/ X/ TT*_ 

s>l ■ i>max{s,J-l} ji,-,js>i ■'■■'■'=-1 

Efe=i ife=' 



3k 



ttCJ fc=l 



s\ — ' "W 

s>\ 1>J-1 



Here we used the inequality 



E 



Efc=i jk=i 



which may be seen by trivially bounding the sum by the number of its terms. Now we change the order of 
summations arriving at 



E ^'re 



ttCJ 



1>J-1 



s^E (^lE^s^E 



n / ^ — ' s 

6>1 



CJe' 



n 



C 



n 



E 



CJe' 



n 



The result follows since for n sufficiently large (such that CJe^ < n) the series in the last expression 
converges. □ 



Remark 4. A typical way Theorem 3 will be applied is as follows. Assume that E Sn and Var Sn are of the 
same order n. Then obviously, (2.7) and (2.8) are satisfied. Assume also that (4.20) and (4.21) hold and 
that Ln is also of order n. Then clearly (4.22) is satisfied and thus (4.23) holds true. 
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5 Applications 



In this section we show how the tools developed in previous section and in particular, the decomposition 
(4.20) together with the condition (4.22) can be conveniently used for proving clt's in several situations, 
mostly in summation schemes of — 1 random variables, as was indicated in Section 2. First, four more or 
less standard limit results for the binomial, negative binomial, hypergeometric and negative hypergeometric 
schemes will be reproved. Then more involved schemes of allocation problems for distinguishable, indis- 
tinguishable balls, colored balls, and random forests will be considered. The clt's for the number of boxes 
with exactly r balls in the first two problems and for the number of trees with exactly r non-root vertices 
in the third problem will be derived. While the clt in the case of distinguishable balls has been known in 
the literature for years (see for instance [16]), the main focus in the other two cases appears to be on the 
local limit theorems (see, e.g. [14, 15, 19]). We have not found any references for the asymptotic normality 
results for the problems we consider in gias models. 

The models 5.2.1-5.2.4 are examples of the generalized allocation scheme (see [14, 15] for more details), 
that is 

P(eS"^ = fci, . . . = kN) = P(r?i = ki,...,riN = kN\rii + ...+m = n), (5.26) 

while models 5.3.1 and 5.3.2 are examples of what may be called the generalized inverse allocation scheme, 
that is 

= fci, . . . = fciv) = P(m = ki,...,m = kN\m + m + --- + 'nN = n + + . . . + fcjv), (5.27) 

where 770, r/i, . . . , t/at are independent random variables. In practical situations of gas models {rij) are iden- 
tically distributed, and in the case of gias we assume that r/j's have the same distribution for j = 1, . . . , iV 
which may differ from the distribution of rj^. 

In the derivations below we will often use the following expansion 

00 j 

(l_«y = e'=i°s(i-t)=e"^-^, (5.28) 
which is valid for any < \a\ < \b\ and any real c. We also recall (see e.g. [5, Chapter 6.5]) that 

M-l /• I T\ 

Qj^M) := E = E T ^^+1-' (5.29) 

k=l 1=1 ^ ^ 

where {Bj.) are the Bernoulli numbers. Clearly, Qj is a polynomial of degree j satisfying (4.21) with C = 1. 
For notational convenience we let 

m— 1 



T{m,t)=ll 



for t > and integer m > 0. It follows from (5.28) and (5.29) that for i > m 
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5.1 Classical discrete distributions 



In this subsection we re-derive asymptotic normality of 



for laws of Sn belonging to four classical families of discrete distributions: binomial, negative binomial, 
hypergeometric and negative hypergeometric. 



5.1.1 Binomial scheme 

Let (ej) be a sequence of lid Bernoulli random variables, P{ei = 1) = p = 1 — P{ei = 0). Then 
Sn = J2i=i has the binomial h{n,p) distribution. To see how Theorem 3 allows in a simple way to 
re-derive de Moivre-Laplace theorem 

Sn - np d ^^^^ ^5 3^^ 



y/np{l -p) 

we set Ln = np. Then E Sn = Ln and Var Sn = Ln{l ~ p)- Furthermore, P(ei = . . . = Cj = 1) = and 
thus by (2.13) it follows that the ith factorial moment of Sn is 

Ci,n = nSn)i = {n)J = 4 T{i, n) . (5.32) 

Thus (5.30) implies representation (4.20) with Qj+i = — Qj+i and (5.31) follows from Remark 4. 

5.1.2 Negative binomial scheme 

Let Sn denote the number of failures until the nth success in Bernoulli trials with p being the probability of 
a success in a single trial, that is, Sn is negative binomial nh{n,p) with 

P(5„ = fe)= (^'' + ^"^)(l-p)V A; = 0,1,.... 

We will show how Theorem 3 allows in a simple way to re-derive the clt for Sn, which says that for 

n — )■ oo 

pSn - n(l - p) d 



y/n{l-p) 



M{0, 1) . (5.33) 



Set Ln = so that E = L„ and Var Sn = Furthermore, the ith factorial moment of Sn is easily 
derived as 

c,,„ = E(5„), = LI, T{i, -n) . 
Hence (4.20) holds with Qj+i = (-1)^+^ Qj+i and thus (5.33) follows from Remark 4. 
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5.1.3 Hypergeometric scheme 



From an urn containing N white and M black balls we draw subsequently without replacement n balls 
(n < min{M, N}). For i = 1, . . . , n, let = 1 if a white ball is drawn at the ith drawing and let = 
otherwise. Then Sn = X^^Li has a hypergeometric distribution Hg{N, M; n), that is, 



(fc) L^k) 

F{Sn = k) = — 7]v+1m\~ ' A; = 0, 1, . . . , n . 

\ n / 

Using again Theorem 3 we will show that under the assumptions N = N {n) ^ oo, M = M{n) ^ oo, 
and TT^jy — > p G (0, 1) with n — >■ oo 



y/nNM{N + M - n)/{N + M - 1 
Setting L„ = we have 

M{N + M - n) 

ES„ = L„ and Var5„ = L„— — Vttttt ■ (5.35) 

Moreover, on noting that (ei, . . . , e„) is exchangeable by (2.13) we get 

Kn)i K )i \\ X ^ (^N + M)i T{i,N + M) 

Similarly as in earlier schemes we obtain representation (4.20) with 

j 



Qj+i 



~ \n) \n + m) 



Moreover, the condition (4.22) is fulfilled since E Sn, Var Sn and L„ are all of order n. See again Remark 4 
to conclude that (5.34) holds true. 



5.1.4 Negative hypergeometric scheme 

Let Sn be a random variable with negative hypergeometric distribution of the first kind, that is, 
P(g„ = fc),(") ^'°" + f-'^" + "-'" i = o,l,...,„, 

\kj B{an,Pn) 
with a„ = na and /3„ = n/3. The clt for S^, says that forra — oo 



(a + /3).5.-nav^ ^ _ 
Vria^(l + a + /3) 



14 



To quickly derive it from Theorem 3 let L„ = and note that E S'n = L„ and Var Sn = Ln {^a+i)^^{ta+nl+i) • 
Further, the zth factorial moment of Sn is easily derived as 

^ -F^c- A _ T{i,n)T{i,^Q.r,) 
T{t,-{a + p)n) 

Thus again due to (5.30) we conclude that representation (4.20) holds with 
The final result follows by Remark 4. 



5.2 Asymptotics of occupancy in generalized allocation schemes (gas) 

In this subsection we will derive asymptotics for Sn"^ = X^iLi -^(^1"^ = several generalized allocation 
schemes as defined at the begiiming of Section 5. As we will see when n — > oo and N/n ^ A G (0, oo] 
the order of E Sn"^ is rf /N'^~^ for any r = 0, 1, . . ., and the order of Var Sn"^ is the same for r > 2. When 
A = oo and r = or 1 the order of Var Sn^ is v?/N. Consequently, we will derive asymptotic normality of 



Sn ^ Sn ^ 



r-l 



when either: 

(a) r > and A < oo or, 

(b) r > 2, A = oo and oo, 

and asymptotic normality of 



2 

when A = oo, ^ — > oo and r = 0, 1. 



^ On -"^ iJn 



n 



Though in all the cases results read hterally the same (with different asymptotic expectations and vari- 
ances and having different proofs) for the sake of precision we decided to repeat formulations of theorems 
in each of subsequent cases. 



5.2.1 Indistinguishable balls 

Consider a scheme of a random distribution of n indistinguishable balls into N distinguishable boxes, such 
that all distributions are equ 
zth box, i = 1, . . . ,N, then 

= n,---,^iv = iN) 



in) 

that all distributions are equiprobable. That is, if = Q denotes the number of balls which fall into the 



n + N 
n 
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for any ik > 0, k = 1, . . . ,N, such that ii + . . . + in = n. Note that this is gas and that (5.26) holds with 

rji ~ Geomip), < p < 1. 

Let Sn^ = Y^f^i -^(Ci = ^) denote the number of boxes with exactly r balls. Note that the distribution 
of (^1, ... , ^n) is exchangeable. Moreover, 

/n-ri+N-i-l\ 

Therefore by (2.13) we get 



Consequently, 

and since Var Sn'^ = C2,n — c\,^ + ci,„ we have 



{n + N - l)nr+i) 

N{N - l){n)r 
{n + N-l)r+i 



(,) ^ N{N-inN-2){n)2r _ f NiN-l){n)r y 
''^ in + N-l)2r+2 \{n + N-l)r+J ^ 



^ N{N-l){n)r 



{n + N- l)r+i ■ 



In the asymptotics below we consider the situation when n ^ oo and ^ ^ A G (0, oo]. Then for any 
integer r > 

A/"''-! / A \ 

^S^n'^-^i r (=lforA = oo). (5.38) 



It is also elementary but more laborious to prove that for any r > 2 and A G (0, oo] or r = 0, 1 and 

A G (0,oo) 



•2\\ ^ 



: cr; (=1 for A = oo) . (5.39) 



Additionally, for A = oo 



^ Var 5^°) ^ 1 =: ^0 and ^Var 5^^) ^ 4 =: 



Similarly, in this case 



^Cov(5(o),5«)^-2 and ^ Cov(5W, 5^) ^ 1. 



and thus for the correlation coefficient we have 

p(4°),5«)^-l and p(5f ,5(2))^1. (5.40) 



Now we are ready to deal with clt's. 
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Theorem 5. Let N/n ^ X e (0, oo]. Let either 

(a) r > and A < oo 
or 

(b) r > 2, A = oo and j^f^ — > oo. 



Then 



Proof. Note that (5.37) can be rewritten as 



: T{i,N)T{i,N -l)T{ir,n) ^ iV(iV - l)n^ 

C,:.„, = -Lr, ^7777 77 77 77 With L„ = 



n T{i{r + l),n + N -I) ^" (n + TV - l^+i ' 

Therefore, similarly as in the previous cases, using (5.30) we conclude that representation (4.20) holds with 



Qj+iii) 



n\o In 

n) ^ [n -1 



Q,+i(i)-Q,+i(ri)+ f J Q,+i((r + l)i). 



To conclude the proof we note that ^Sn \ YarSn^ and L„ are of the same order n/'/N^ ^ and use Re- 



mark 6 stated below. 



□ 



(r) (r) 

Remark 6. // E 5A ' and Var S^i ' are of the same order and diverge to oo then (2.7) and (2.8) hold. 
Moreover, if and Var Sn"^ are both of order rf /N'^~^ then the left hand side of (4.22) is of order 

1 



n 



J-i \ ]\[r-l 



n\ii'-i) 1 



That is, when either A G (0, oo) and r = 0,1, ... or X = oo and r = 2, 3 . . . the condition (4.22) is satisfied. 



In the remaining cases we use asymptotic correlations 
Theorem 7. Let N/n oo and v? /N — > oo. Then for r = 0,1 



Vn 



M (0, a^^) 



Proo/ Due to the second equation in (5.40) it follows that 



5f -EgW 

CTon (72?^ 

Therefore the result for r = holds. Similarly, for r = 1 it suffices to observe that the first equation in 
(5.40) impUes 

O(0) Tff oiO) qW Tff qW ,2 



cron 



(Tin 



□ 
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5.2.2 Distinguishable balls 



Consider a scheme of a random distribution of n distinguishable balls into N distinguishable boxes, such 
that any such distributi( 
zth box, i = 1, . . . ,N, 



(n) 

that any such distribution is equally Ukely. Then, if = Q denotes the number of balls which fall into the 



mi = k,---,CN = iN) = . , " . 

for any i/ > 0, I = 1, . . . , iV, such that ii + . . . + = n. This is a gas with r]i ~ Poisson{X), A > 0, in 
(5.26). 

For a fixed nonnegative integer r let 

N 

1=1 

be the number of boxes with exactly r balls. Obviously, the distribution of (^i, . . . , ^at) is exchangeable and 

I / • \ n—ir 

71 ' ■ / 1 

nil = ... = ii = r)= • . /V- 1 - - 

[r\y[n — ir)\ \ N 



Therefore by (2.13) we get 



n—ir 



«,»=^(sr). = ^^(l-^) . (5.4.) 



Consequently, for any r = 0, 1, . . . 

JC^-^n -Cl,n- 

and 



In the asymptotics below we consider the situation when n — > oo and ^ A G (0, oo]. Then for any 
integer r > 

TV"^ 1 1 / 1 

lim E^^'') = -e-A = - for A = oo ) . (5.42) 



-E^^'') = 4e"^ (= 4 for A = ooV 
" r! V ^' / 



It is also elementary but more laborious to check that for any fixed r > 2 and A G (0, oo] or r = 0, 1 and 

A G (0,oo) 



Additionally, for A = oo 



N 



2 Var ^ i =: and ^ Var 5^^) ^ 2 =: a^ 
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1 



Similarly one can prove that 

^Cov(SW,4i))^-l. 
Therefore for the correlation coefficients we have 

Since 

^Var5^)^l = af and ^^Co.{Si^\ S^?^) 
we also have 

We consider the cases when r > 2 and A = oo or r > and A G (0, oo). 

Theorem 8. Let N/n ^ Xe (0, oo]. Let either 

(a) r > and A < oo 

or 

(b) r > 2, A = oo and — )■ oo. 



Then 



Proo/ Write Ci,„ as 

(■ \ n—ir r - 

T{i,N)T{ir,n), where = ^ 

Then, the representation (4.20) holds with 

«^«(') = ('' - JTI ^) (^)' - (^)' «^«<'* - 

Since E Sn \ Var S'^'^^ and L„ are of order rf /N^"^ the final result follows by Remark 6. 

Similarly as in the case of indistinguishable balls, using (5.45) and (5.44) we get 
Theorem 9. Let N/n oo and n^/N oo. Then for r = 0, 1 
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5.2.3 Colored balls 



An urn contains NM balls, M balls of each of colors. From the urn a simple random sample of n 
elements is drawn. We want to study the asymptotics of the number of colors with exactly r balls in the 

in) 

sample. More precisely, let = Q denote the number of balls of color i,i = l,...,N. Then 

TT- i^^) 

\ n I 

for all integers ki> ^, i = \^ . . . ,N , such that Yli=i — ^- Obviously, the random vector (^i, . . . , ^n) is 
exchangeable and the gas equation (5.26) holds with r]i ~ b{M,p), < p < 1. 

For an integer r > we want to study the asymptotics of 

N 

1=1 

For the ithe factorial moments we get 

^My /{N-i)M\ 
\ r / \ n— ri ) 

Consequently, for any r = 0, 1, . . . 

(M\ ({N-1)M 



Ci,n = {N)i P(6 = ...ii = T) = (iV), ^-^;^;-" ' . (5.46) 



fM\ nN-l)M\ 
m _ _ jw- U A n-r ) 



and 

/M\2 /(Ar-2)JM'\ /M\2/(Ar-l)M\2 tM\f{N-\)M\ 

-ar ci(r) 2 I ATfAT t \ ^ f ' ^ n—2r ) 117-2 \ r / V n—r ) , at V r / \ n—r ) 

Var5^^ =C2,n-Ci,„ + ci,n = iV(iV-l) AT + N . 

In the asymptotics below we consider the situation when n — > cxd, ^ — )• A G (0, oo], and M = M{n) > n. 

Although the computational details are different, asymptotic formulas for E Sn^ , Var Sn ^ , Cov (si^^ , Sn"* ) 
and CoY{S^n^ , Sn^ ) are hterally the same as for their counterparts in the case of occupancy for distinguish- 
able balls studied in Subsection 5.2.2. 

First we will consider the limit result in the case r > 2, A = oo, and r > 0, A G (0, oo). 

Theorem 10. Let N/n ^ A G (0, oo] and M = M{n) > n. Let either 

(a) r > and A < oo 
or 

(b) r > 2, A = oo and jjh^ — >■ oo. 



Then 
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M 



Proof. Rewrite the formula (5.46) as 

_ , r((M - r)z, NM - n) T(z, N) Tjrz, n) -.r^r(M\ (l - 

Thus the representation (4.20) holds with 

We need to see that the polynomials Qj satisfy bound (4.21). This is clearly true for each of the last two 
terms in the above expression for Qj+\. For the first two terms we have 

n \j 



Mi-l 



k=l 



n 



Since 



and 



< 



n \j 



n y 
NMJ 



n 



NM -n 

j 



j (Af-r)i-l 
k=l 



NM - n 



j Mi-l 



k={M-r)i 



NM 



n 



NM - n 



< 



n 



jn 



< 



NM -n NM - V NM -n NM 



2n 



n 



Mi-l 



k={M-r)i 

and Qj+i{Mi) < M^+^ we conclude that Qfs do satisfy (4.21). 

Clearly, E si[\ Var si[^ and L n are of order n' jN'' ^ and again we conclude the proof by referring to 
Remark 6. □ 



Asymptotic normaUty for Sn^ and Sn^ for A = oo also holds with the exact statement identical to 
Theorem 9 for distinguishable balls. 



5.2.4 Rooted trees in random forests 



Let T{N n) denote a forest with N roots (that is N rooted trees) and n non-root vertices. Consider a 
uniform distribution on the set of such T(Ar, n) forests. Let = , i = 1, . . . , iV, denote the number 
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of non-root vertices in the ith tree. Then (see for instance [3], [18] or [19]) for any ki > such that 

Eili ki = n 



ni 



nil {h + 1)'^-' 



Note that this distribution is exchangeable and that it is a gas with rji in (5.26) given by 

P(ry, = fe) = ^'^^|/^'"' e-(fe+i)\ k = 0,l...; A > 0. 
kl 

We mention in passing that the distribution of rji may be identified as Abel distribution discussed in [17] 
with (in their notation) p = 1 and 9 = InX — X. We refer to Example D in [17] for more information on 
Abel distributions, including further references. 

(r) 

For a fixed number r > we are interested in the number Sn of trees with exactly r non-root vertices 

N 



i=l 

(r) 

Since the ith factorial moment of Sn is of the form 



Q,„ = (iv)iP(ei = ... = ei = r-) 

we have to find the marginal distributions of the random vector (^i , . . . , ^jv). From the identity 



my-. 

^ \k) - ^ + s)™"'"' = (s + l)(m + 1 + s 



s 

k=0 



m—1 



which is vaUd for any natural m and s we easily obtain that for kj > such that Yl]^\ = 



n^i = ki,...,^i = ki)- 



{N - i){ki+i +N- ri;=i {kj + 1)''^-^ 



Therefore 



Hence 



]X+\kj\ N{N + n)^-^ 

_ (r + l)-(-i) N-i {NUnU / (r + l). y-^ 

(riy N (n + N-{r + V n + N J ' ^ 



• ^ , ^ {r + iy-^ {N-l){n)r ( _ r + l_ 
" r! (n + AT-r-l)'^ V " + ^ 



Thus if N/n ^ A G (0, oo] we have 

E S)^> r e ^+1 = -^^ r for A = oo 

Since Var Sn^ = C2,„ — cf „ + ci,„ elementary but cumbersome computations lead to 
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r+1 

e ^+1 



A(r + 1) 
(r + 1)! V A + 1 



r+l 



r + 1 



(r + 1)! VA + 1 



- A 



e ^+1 (Ar - 1) \ / A(r + 1) 



(r + l)!(A + l)i V(^ + l)' 



for r > 2 and A G (0, oo] and for r = 0, 1 and A G (0, oo). For r = 0, 1 and A = oo, and n^/N — > oo we 
have 

^Var5W^| = ag and ^Var^W ^ 



Similarly one can prove that 



N 



^Cov(SW,sW)^-3. 



Therefore for the correlation coefficients we have 

p{S^\S^))^-l. 

Since 



n 



Var5^)^| = af and Cov(5f , 5^)) ^ 1 



n 



we also have 



Theorem 11. Let N/n ^ X e (0, oo]. Let either 

(a) r > and A < oo 
or 

(b) r > 2, A = oo anJ j^F=rr — > oo. 



Then 



^/rf~/N' 



r-l 



AT (0,(7,2) 



(5.48) 



(5.49) 



(r) (r) 

Proof. Since the asymptotics of VarS'n and E 5„ is of the same order as in Theorem 5.2.2 the conditions 
(2.7) and (2.8) are satisfied. Using (5.47) we write 



(n-l)(r+l) / (r+ l)i 



where 



n + N 
N{r + 1)'-^ 



n—l—ri 



T{i + l,N)T{ri,n), 



n + N 



n \ ' (n-l)(r-+l) 
g n+AT 



Thus the representation (4.20) holds true with 



Qj+i(i) 



j{r + l){n-l)\ fir + l){n-l)y 



(i + l)(n + Ar) 



n + N 



Qj+iii + l)-Qj+i{ri). 



The final result follows again by Remark 6 on noting that E Sn \ Var Sn^ and L„ are of order n'^/N'^ ^. □ 
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Again, as in previous cases we use (5.48) and (5.49) to arrive at 
Theorem 12. Let N/n oo and r? jN oo. Then for r = 0, 1 

n ^ ' 

5.3 Asymptotics in generalized inverse allocation schemes (gias) 

Our final two settings are examples of the gias as defined in (5.27). Similarly to the case of gas for S)i ' = 
^iLi ^(Ci^^ = we will obtain asymptotic normality of 

when N/n -)■ X £ (0, oo). 

5.3.1 Exchangeable negative multinomial model 

Let {^i) = (^1"^) be a random vector with a negative multinomial distribution, that is 

(n + ki)l . 

11^=1 ¥ 

Note that this is an exchangeable case of a model usually referred to as Bates-Neyman model introduced 
in [1]. We refer to [9, Chapter 36, Sec. 1-4] for a detailed account of this distribution, its properties, 
applications, and further references. Here, we just note that this is a gias for which (5.27) holds with 
riQ ~ Poisson(Ao), rji ~ Poisson{\\), i = 1, . . . , N, andp = ^q+nXi ■ 

For a fixed integer r we are interested in the asymptotics of 

N 

Denoting /3„ = (Np)~^ — 1 we obtain 

" ^ n!(r!)* (iV^„ + ^)n+ri- ^^-^"^ 

To study the asymptotic properties of Sn^ we will assume that N/n ^ A G (0, oo). Moreover we let 
p = Pn depend on n in such a way that Npn ^ a G (0, 1), i.e. ct^^ — 1- Consequently, setting 

A(l^'f^^^y^ = 0'l'■■■ 
n-^oo n r! 
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and 



lim lvarSW = ^^^ 

n— >oo n f\ 



r„-A 



-(l-A(r-Af) 



Theorem 13. Let N/n ^ \ G {0, oo) and Npn — > a G (0, 1). Then for any r = 0, 1, . . . 
wjY/z defined in (5.51). 



(5.51) 



Proof. Write (5.50) as 



Ci,n = V^e^Pn^ -J ' ^ with L, 



Thus the representation (4.20) holds true with 



Qj+i(i) = [r- 



jn 



{j + l)N/3nJ V m 



n 



iJ+^ + (-l)^+iQ,.+i(.i + 1) - (^)^ Q,.+l(^). 



Moreover, ES^', Var 5"^ ' and L„ are all of order n and thus the final conclusion follows from Remark 4. □ 



5.3.2 Dirichlet negative multinomial model 

Finally we consider exchangeable version of what is known as Dirichlet model of buying behavior intro- 
duced in a seminal paper by Goodhardt, Ehrenberg and Chatfield [4] and subsequently studied in numerous 
papers up to the present days. This distribution is also mentioned in [9] (see Chapter 36, Sec. 6 of that book). 

(n) 

Writing, as usually, Q = ^i, the distribution under study has the form 

, + ki) ! r{Na + b) r(n + b) Uf=i ^kj + a) 



n! nf=i kj\ r^{a)m r[Na + b + n + Ef=i h) 



for any fcj = 0, 1, . . ., i = 1, . . . , A'^. Here n > is an integer and a, 6 > are parameters. This is again a 
gias with rji ~ nb{a,p), i = 1,. . . ,N and rjo ~ nb{b,p), < p < 1. When a and b are integers we recall 
a nice interpretation of (^i, . . . , ^jv) via the Polya urn scheme: An urn contains h black balls and a balls in 
each of N non-black colors. In subsequent steps a ball is drawn at random and returned to the urn together 
with one ball of the same color. The experiment is continued until the nth black ball is drawn. Then is 
the number of balls of the iih color at the end of experiment, i = 1,... ,N. This distribution can also be 
viewed as multivariate negative hypergeometric law of the second kind. 

From the fact that Ci,„ = (A/")jP(^i = . . . = = r) we get 

_ {n + ri)ir{ia + b) r(n + b)P(r + a) 

^ n\{r\y ri{a)r{b)r{{r + a)i + n + by ^ ^ ^ 
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To study the asymptotic behavior of Sn^ we will assume that N/n ^ A G (0, oo) and that b = bn depends 
on n in such a way that bn/n ^ P > 0. 



Below we use the following product representation of Gamma function 

1 ~ 

r(-) = ^ n 



(5.53) 



where 7 is the Euler constant and x > 0. We also recall (see e.g. [23, Section 12.16]) that for a digamma 
function = ^ln(r(x)) we have 



*(x + 1) = -7 + E(s-J^) -/-I. -2,. 

fe>l ^ 



Then for any < x < y we can write 



r(y) x + y 



and the series Y^k>i {^-^ - log ^1 + ^f^)) converges. Note that, 

*(y) — Iny— >-0 as y — > 00 
so that, if an/n a then for any x > 



(5.54) 



(5.55) 



n 



.T{an + x) 

r(Q!„) 



Consequently, 



Similarly, 



Inn iE5W = ^£(^^^ 
n^co n r!r(a) (1 + /3)«+'^ ' 



lim Var^r^ 
n-i-oo r!r(a)(l + 



1 - 



r(r + a)^« 1 + A(^ 



r!r(a)(l + /3)«+^ 

Theorem 14. Le? AT/n ->■ A G (0, 00) and bn/n P e {0, 00). Then for any r = 0, 1, . . . 
wjYft (T,^ defined in (5.56). 



=: (5.56) 



Proof. Note that (5.52) can be written as 

c^,n = (^^^^) ^ Ti^r + 1, -n) T(^, N) ^^'^ + + ^'^^ 



r!r(a) ; ^ ' / v / r(6„) r(n + 6„ + z(r + a)) ' 



26 



Moreover, setting 



1 



we see that (5.54) can be developed into 

r(y) 



, X > 0, j>2. 



hj{y)) 



Therefore, taking (x, y) = (za, 6„) and (x, y) = {i{r + a), n + 6„) we decompose Ci,„ according to (4.20) 
where 

_ iVr(r + a)rf 
r!r(a) 



and 



n(r + aj 
6„ + n 



no 

br,. 



ji-n) 



{-ly+H^ + '-j^ [{r + ay+%ibn + n) - a^+'hj{bn)] 



+(-l)^+iQ,+i(ir + l)-(^)'Q,+i(z). 



On noting that an/n — > a implies that n^gj{an) < c'{a) uniformly in n we conclude that polynomials 

(r) (r) 

Qj satisfy condition (4.21). Moreover, (5.55) yields that L„ is of order n. Since E Sn and Var Sn are of 
order n too, the result follows by Remark 4. □ 
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